Development and Validation of a Scoring Rubric for Editorial Evaluation of Peer-review Quality: A Pilot Study.

Introduction: Despite the importance of peer review to publications, there is no generally accepted approach for editorial evaluation of a peer review's value to a journal editor's decision-making. The graduate medical education editors of the Western Journal of Emergency Medicine Special Issue in Educational Research & Practice (Special Issue) developed and studied the holistic editor's scoring rubric (HESR) with the objective of assessing the quality of a review and an emphasis on the degree to which it informs a holistic appreciation for the submission under consideration. Methods: Using peer-review guidelines from several journals, the Special Issue's editors formulated the rubric as descriptions of peer reviews of varying degree of quality from the ideal to the unacceptable. Once a review was assessed by each editor using the rubric, the score was submitted to a third party for blinding purposes. We compared the performance of the new rubric to a previously used semantic differential scale instrument. Kane's validity framework guided the evaluation of the new scoring rubric around three basic assumptions: improved distribution of scores; relative consistency rather than absolute inter-rater reliability across editors; and statistical evidence that editors valued peer reviews that contributed most to their decision-making. Results: Ninety peer reviews were the subject of this study, all were assessed by two editors. Compared to the highly skewed distribution of the prior rating scale, the distribution of the new scoring rubric was bell shaped and demonstrated full use of the rubric scale. Absolute agreement between editors was low to moderate, while relative consistency between editor's rubric ratings was high. Finally, we showed that recommendations of higher rated peer reviews were more likely to concur with the editor's formal decision. Conclusion: Early evidence regarding the HESR supports the use of this instrument in determining the quality of peer reviews as well as its relative importance in informing editorial decision-making.

A Collaborative Approach to Mentored Peer Reviews Sponsored by the Council of Residency Directors in Emergency Medicine.

Introduction: Historically, there have been no systematic programs for teaching peer review, leaving trainees to learn by trial and error. Recently, a number of publications have advocated for programs where experienced reviewers mentor trainees to more efficiently acquire this knowledge. Objective: Our goal was to develop an introductory learning experience that intentionally fosters peer-review skills. Methods: The Council of Residency Directors in Emergency Medicine (CORD) offered education fellowship directors the opportunity to mentor their fellows by reviewing submitted manuscript(s) supplemented by educational material provided by their journal. Reviews were collaboratively created. The decision letter that was sent to manuscript authors was also sent to the mentees; it included all reviewers' and editor's comments, as feedback. In 2022, fellows received a post-experience survey regarding prior experiences and their perspectives of the mentored peer-review experience. Results: From 2020-2022, participation grew from 14 to 30 education fellowships, providing 76 manuscript peer reviews. The 2022 survey-response rate of 87% (20/23) revealed that fellows were inexperienced in education scholarship prior to participation: 30% had authored an education paper, and 10% had performed peer review of an education manuscript. Overall, participants were enthusiastic about the program and anxious to participate the following year. In addition, participants identified a number of benefits of the mentored experience including improved understanding of the scholarship process; informing fellows' scholarly pursuits; improved conceptualization of concepts learned elsewhere in training; and learning through exposure to scholarship. Conclusion: This program's early findings suggest that collaboration between academic societies and interested graduate medical education faculty has the potential to formalize the process of learning peer review, benefitting all involved stakeholders.

A Profile of Orthopedic Education in Emergency Medicine Residency Programs in the United States.

Introduction Emergency medicine (EM) residents throughout the United States are required to become skilled at performing a robust list of select orthopedic procedures, as well as learn how to diagnose and manage patients with musculoskeletal complaints. However, EM residency programs vary significantly in how they teach orthopedics and the content they cover. The purpose of this study was to profile the orthopedic education received by emergency medicine residents in United States residency programs. Methods We developed a survey based on accreditation requirements and The Model of the Clinical Practice of Emergency Medicine. The survey was designed to gather detailed information about the orthopedic education provided to EM residents. The survey was sent to EM program directors or their designees at all 263 accredited EM residency programs across the United States between October 2020 to January 2021. Results We attained a 34.6% (91 of 260) adjusted response rate with adequate representation of relevant program characteristics such as region, accreditation status, program length, size, and setting. Most (63.7%) responding programs required an orthopedics rotation during the intern year. These required orthopedic rotations were primarily four weeks in duration. The most common methods for teaching orthopedic topics included didactics (97.8%), procedures on live patients under supervision (73.3%), and assigned reading materials in textbooks or manuals (68.9%). Conclusion The orthopedic education received by EM residents in the United States is strikingly variable, with residency programs having to develop custom curricula to teach orthopedics content based on the resources available to them. Future efforts should be directed toward creating a universal curriculum that addresses accreditation and EM practice standards.

Disrupting Faculty-on-Faculty Bullying in Academic Medicine: An Innovative Workshop.

Introduction: Bullying, a severe form of mistreatment, occurs when an individual in an authority position intentionally imposes negative persistent behaviors on a target. In academic medicine, bullying is used to impede the target's professional growth. While there is abundant literature on how to disrupt other forms of mistreatment, the literature related to bullying among academic medical faculty members is scarce. Methods: We developed an interactive workshop on disrupting faculty-on-faculty bullying in academic medicine, with a focus on gender-based bullying, following Kern's model of curriculum development. The workshop consisted of three didactics on the scope of bullying in academic medicine: identifying bullying behaviors, learning strategies to mitigate bullying, and understanding what constitutes comprehensive antibullying policies. The workshop also included three small-group activities to reinforce learned concepts. Results: Eighty-seven faculty attended one of three workshops held over a 6-month period. We received 24 completed evaluations for a 28% rate of return. Most participants rated workshop activities as being well taught and of great value. Many respondents commented that after participating in the workshop, they realized they had likely experienced or witnessed bullying in their careers and that mitigating bullying required effort at multiple levels (individual, institutional, national). Discussion: This workshop fills a need in academic medicine through addressing how faculty members and institutions can help themselves and others to disrupt bullying. We will continue to disseminate this workshop at national conferences and at individual institutions. This resource will allow other educators to offer the workshop at their home institutions.

First Responder Virtual Reality Simulator to train and assess emergency personnel for mass casualty response.

As mass casualty incidents continue to escalate in the United States, we must improve frontline responder performance to increase the odds of victim survival. In this article, we describe the First Responder Virtual Reality Simulator, a high-fidelity, fully immersive, automated, programmable virtual reality (VR) simulation designed to train frontline responders to treat and triage victims of mass casualty incidents. First responder trainees don a wireless VR head-mounted display linked to a compatible desktop computer. Trainees see and hear autonomous, interactive victims who are programmed to simulate individuals with injuries consistent with an explosion in an underground space. Armed with a virtual medical kit, responders are tasked with triaging and treating the victims on the scene. The VR environment can be made more challenging by increasing the environmental chaos, adding patients, or increasing the acuity of patient injuries. The VR platform tracks and records their performance as they navigate the disaster scene. Output from the system provides feedback to participants on their performance. Eventually, we hope that the First Responder system will serve both as an effective replacement for expensive conventional training methods as well as a safe and efficient platform for research on current triage protocols.

Deriving National Continued Competency Priorities for Emergency Medical Services Clinicians.

OBJECTIVE: Continued competency is poorly defined in emergency medical services (EMS), with no established method for verifying continued competency at a national level. The objective of this project was to refine understanding of continued competency for EMS clinicians in the U.S. and establish priorities for developing competency assessments. METHODS: A panel of EMS managers, educators, medical directors, and experts in competency assessment, simulation, and certification used a modified Delphi technique to address two questions: "What is the content for continued competency in EMS that should be assessed or verified?" (content) and "How should continued competency of EMS clinicians be demonstrated?" (process). The Delphi process was conducted through electronic conferencing and survey software over a 6-month period. In round one, panelists responded to open-ended prompts and their contributions were analyzed and categorized into themes by independent reviewers. In round two, the panel rated theme importance using five-point Likert-type scales. In round three, the panel ranked their top 10 themes, and in round four, the panel selected the most important themes for each of the two questions through consensus-building discussions. Descriptive statistics and thematic analyses were performed with Excel and STATA 16. RESULTS: Fourteen invited experts participated in all Delphi activities. The panel contributed 70 content and 35 process items from the original prompts. Following thematic analysis, these contributions were reduced to 21 and 14 unique themes, respectively. The final top five prioritized themes for content important for continued competency included (1) airway, respiration, and ventilation, (2) patient assessment, (3) pharmacology, (4) pediatrics, and (5) management of time critical disease progressions. The final top five prioritized themes for the processes for continued competency assessment included (1) assessments of evidence-based practice, (2) performance-based assessments, (3) combined knowledge and skill assessments, (4) performance improvement over time, and (5) frequent, short knowledge assessments. CONCLUSION: This modified Delphi process identified priorities for content and assessment, laying the groundwork for EMS continued competency at a national level. These findings can be leveraged by national task forces to develop transparent and consistent guidelines for systems that verify continued competency related to certification, licensure, and local credentialing.

Bullying in Academic Medicine: Experiences of Women Physician Leaders.

PURPOSE: Bullying is defined as offenders abusing positions of authority and intentionally targeting individuals through persistent negative behaviors to impede education or career growth. This study sought to estimate the prevalence and nature of bullying experienced by women physician leaders in academic medicine. METHOD: In this survey-based study, 547 physician graduates of an executive women's leadership training program were invited to complete a survey that measured workplace bullying in 2021. Participants were asked whether and when they had been bullied, how it impacted their careers, and remedies for bullying. Descriptive statistics were used to profile mistreatment and bullying experienced by the respondents during their professional careers and the nature of bullying. Content analysis of open-ended comments was used to describe how bullying impacted women physicians and outline recommendations for bullying prevention and mitigation. RESULTS: The survey response rate was 64.7% (354/547). Most women (302/354 [85.3%]) had experienced mistreatment during their careers, with more than half experiencing bullying while an attending physician (198/302 [65.6%]). Many women (187/302 [61.9%]) who screened positive for mistreatment also reported that they had been bullied at work. Of these 187 respondents, 173 (92.5%) experienced bullying from men and 121 (64.7%) reporting bullying from women (effect size = 0.34, P ≤ .001), and 115 (61.5%) reported that bullies were their immediate supervisors. Qualitative findings suggested that bullying harmed individuals' career advancement, mental health, reputation, and relationships with others. Many had to change roles or leave jobs. Participants proposed that initiatives by top-level leaders, clear definitions of bullying behavior, reporting mechanisms, and upstander training for faculty and staff could mitigate bullying. CONCLUSIONS: Most women physician leaders have experienced bullying. These results highlight the need to address bullying in academic medicine so that women can reach their full career potential.

Why Gender-Based Bullying Is Normalized in Academic Medicine: Experiences and Perspectives of Women Physician Leaders.

Background: Bullying has been identified as a problem in the academic medicine. Bullying behaviors persist because organizational cultures have allowed them to become normalized. In academic medicine, women are more likely to be bullied than men. Our purpose was to explain why gender-based bullying persists in academic medicine and identify mitigation strategies. Methods: We interviewed senior faculty women physicians who graduated from the Hedwig van Ameringen Executive Leadership in Academic Medicine® program. We asked participants about their experience with bullying and its consequence on their careers. We also asked about the types of culture they think perpetuates bullying and their thoughts on how best to mitigate bullying. Interviews were recorded, transcribed, and coded using Averbuch's Cycle of Academic Bullying as a framework. Results: We sampled 30 women physician leaders for interviews from a pool of 96 volunteers who had screened positive for experiencing bullying. All 30 either experienced or witnessed bullying during their careers. Bullying behaviors included public humiliation, defamation, verbal disparagement, and social isolation. Subjects suffered numerous negative effects from bullying such as stress, burnout, depression, and having to leave the job. Participants believed bullying behaviors persisted due to hierarchical organizational cultures. Barriers to reporting and mitigation were thought to originate from lack of leadership combined with ineffective policies and reporting mechanisms. Conclusions: Dysfunctional hierarchies embedded in organizational cultures within academic medicine have contributed to the normalization of bullying. Committed leadership, focused on implementing comprehensive bullying prevention policies, is needed to promote an inclusive culture in which everyone feels that they belong.

How do emergency medicine applicants evaluate residency programs in the post-COVID-19 era?

Objectives: Pandemic disruptions to interviews and away rotations led applicants to rely on alternative sources of information about residency programs. We sought to compare program characteristics important to emergency medicine (EM)-bound applicants from before and after the pandemic. We also investigated the sources of information pandemic impacted applicants used during residency recruitment. Methods: This was a multi-institutional, cross-sectional survey of applicants to EM residency programs. We asked applicants about important factors in choosing a program and compared their response to results from 2019 National Residency Match Program. We also asked about alternative information sources used during this time of restricted access to programs of interest. Results: We surveyed 414 applicants from 40 medical schools and attained a response rate of 38.4%. Compared to 2019 applicants, our respondents identified morale of residents and quality of faculty as important factors in choosing a residency. Our subjects cited websites of the program and hospital affiliate, current residents, faculty/mentor advice, Reddit, and Doximity as sources of program information. Conclusions: Compared to 2019, our EM-bound applicants who, because of the pandemic, were unable to visit programs of interest valued resident morale and faculty quality as factors in choosing a residency program. Without in-person visits, our subjects also had to use both virtual resources (e.g., websites) and traditional sources (e.g., mentor advice) to investigate a program's culture, reputation, and diversity and inclusion. Residency programs should monitor their online presence now that this has become an alternative source of information for applicants during curtailment of in-person visits.

Residents' Perspective on Need for Point-of-Care Ultrasound Education During Pediatric Residency.

OBJECTIVES: Many medical disciplines incorporate point-of-care ultrasound (POCUS) into their practice. Despite well-defined applications, POCUS has not been widely adopted in pediatrics and is not commonly taught during residency. Our objective was to profile the current state of POCUS education in pediatric residency training from the resident perspective. METHODS: We surveyed pediatric trainees about their POCUS education, general opinions about POCUS, and perceived barriers to POCUS training in residency. We distributed the survey to a random sample of Ohio pediatric residents, stratified by program size and training level. Descriptive statistics were used to characterize responses. RESULTS: We sampled 66.4% of the population (371 of 559) of Ohio pediatric residents and achieved a response rate of 59.3%. Only 15% of respondents received POCUS training during residency, with 85% having never performed a POCUS scan. Most (86%) desired POCUS education and 67% believed it should be required during residency. Residents felt that POCUS would be useful for procedural guidance (95%), clinical diagnosis (94%), and patient safety (74%). Most residents (61%) believed POCUS education would benefit their careers, particularly those planning on subspecialization. Barriers to POCUS education included lack of an established curriculum (75%), competing educational priorities (58%), and a shortage of qualified instructors (52%). CONCLUSIONS: Although Ohio pediatric residents do not receive formal POCUS education in residency, they desire such training and believe it would benefit their future practice. Consensus on scope of practice, development of a standardized curriculum, and increased faculty training in POCUS may help address this educational gap.

Emergency medicine resident clinical experience vs. in-training examination content: A national database study.

Objectives: Emergency medicine (EM) residents take the In-Training Examination (ITE) annually to assess medical knowledge. Question content is derived from the Model of Clinical Practice of Emergency Medicine (EM Model), but it is unknown how well clinical encounters reflect the EM Model. The objective of this study was to compare the content of resident patient encounters from 2016-2018 to the content of the EM Model represented by the ITE Blueprint. Methods: This was a retrospective cross-sectional study utilizing the National Hospital Ambulatory Medical Care Survey (NHAMCS). Reason for visit (RFV) codes were matched to the 20 categories of the American Board of Emergency Medicine (ABEM) ITE Blueprint. All analyses were done with weighted methodology. The proportion of visits in each of the 20 content categories and 5 acuity levels were compared to the proportion in the ITE Blueprint using 95% confidence intervals (CIs). Results: Both resident and nonresident patient visits demonstrated content differences from the ITE Blueprint. The most common EM Model category were visits with only RFV codes related to signs, symptoms, and presentations regardless of resident involvement. Musculoskeletal disorders (nontraumatic), psychobehavioral disorders, and traumatic disorders categories were overrepresented in resident encounters. Cardiovascular disorders and systemic infectious diseases were underrepresented. When residents were involved with patient care, visits had a higher proportion of RFV codes in the emergent and urgent acuity categories compared to those without a resident. Conclusions: Resident physicians see higher acuity patients with varied patient presentations, but the distribution of encounters differ in content category than those represented by the ITE Blueprint.

Development of a Balloon Tamponade Task Trainer.

Variceal hemorrhage is a life-threatening complication of patients with cirrhosis. If a patient is hemodynamically unstable and unable to undergo endoscopic therapy, a balloon tamponade device may be placed to temporize the hemorrhage until definitive management may be performed. Placement of these devices may be performed by practitioners of several different medical specialties. Placement of balloon tamponade devices requires multiple steps and several different pieces of equipment. Performing the procedure incorrectly can lead to iatrogenic injuries such as esophageal necrosis or perforation. Since this is a relatively rare procedure often placed under high-stress situations, practicing in a low-stakes setting, such as a simulation lab, allows practitioners to hone their skills. Commercially available task trainers for balloon tamponade device placement are not available. In this paper, we describe how to modify an inexpensive airway task trainer for this purpose using commonly available and cost-effective materials.

Procedural Curriculum to Verify Intern Competence Prior to Patient Care.

INTRODUCTION: Emergency medicine (EM) programs train residents to perform clinical procedures with known iatrogenic risks. Currently, there is no established framework for graduating medical students to demonstrate procedural competency prior to matriculating into residency. Mastery-based learning has demonstrated improved patient-safety outcomes. Incorporation of this framework allows learners to demonstrate procedural competency to a predetermined standard in the simulation laboratory prior to performing invasive procedures on patients in the clinical setting. This study describes the creation and implementation of a competency-based procedural curriculum for first-year EM residents using simulation to prepare learners for supervised participation in procedures during patient care. METHODS: Checklists were developed internally for five high-risk procedures (central venous line placement, endotracheal intubation, lumbar puncture, paracentesis, chest tube placement). Performance standards were developed using Mastery-Angoff methods. Minimum passing scores were determined for each procedure. Over a two-year period, 38 residents underwent baseline assessment, deliberate practice, and post-testing against the passing standard score to demonstrate procedural competency in the simulation laboratory during intern orientation. RESULTS: We found that 37% of residents required more than one attempt to achieve the minimum passing score on some procedures, however, all residents ultimately met the competency standard on all five high-risk procedures in simulation. One critical incident of central venous catheter guideline retention was identified in the simulation laboratory during the second year of implementation. CONCLUSION: All incoming first-year EM residents demonstrated procedural competence on five different procedures using a mastery-based educational framework. A competency-based EM curriculum allowed for demonstration of procedural competence prior to resident participation in supervised clinical patient care.

A contemporary reassessment of the US surgical workforce through 2050 predicts continued shortages and increased productivity demands.

BACKGROUND: We aimed to predict practicing surgeon workforce size across ten specialties to provide an up-to-date, national perspective on future surgical workforce shortages or surpluses. METHODS: Twenty-one years of AMA Masterfile data (1997-2017) were used to predict surgeons practicing from 2030 to 2050. Published ratios of surgeons/100,000 population were used to estimate the number of surgeons needed. MGMA median wRVU/surgeon by specialty (2017) was used to determine wRVU demand and capacity based on projected and needed number of surgeons. RESULTS: By 2030, surgeon shortages across nine specialties: Cardiothoracic, Otolaryngology, General Surgery, Obstetrics-Gynecology, Ophthalmology, Orthopedics, Plastics, Urology, and Vascular, are estimated to increase clinical workload by 10-50% additional wRVU. By 2050, shortages in eight specialties are estimated to increase clinical workload by 7-61% additional wRVU. CONCLUSIONS: If historical trends continue, a majority of surgical specialties are estimated to experience workforce deficits, increasing clinical demands substantially.

Design of a point-of-care ultrasound curriculum for pediatric emergency medicine fellows: A Delphi study.

OBJECTIVES: There has been a steady increase in the growth and utilization of point-of-care ultrasound (POCUS) in pediatric emergency medicine (PEM). POCUS has been established as an Accreditation Council for Graduate Medical Education (ACGME) core requirement for accreditation of PEM fellowship programs. Despite this requirement, training guidelines regarding POCUS knowledge and skills have yet to be developed. The purpose of this project was to develop a curriculum and a competency checklist for PEM fellow POCUS education. METHODS: We formed a core leadership group based on expertise in one or more key areas: PEM, POCUS, curriculum development, or Delphi methods. We recruited 29 PEM POCUS or ultrasound education experts from North America to participate in a three-round electronic Delphi project. The first Delphi round asked experts to generate a list of the core POCUS knowledge and skills that a PEM fellow would need during training to function as an autonomous practitioner. Subsequent rounds prioritized the list of knowledge and skills, and the core leadership group organized knowledge and skills into global competencies and subcompetencies. RESULTS: The first Delphi round yielded 61 POCUS areas of knowledge and skills considered important for PEM fellow learning. After two subsequent Delphi rounds, the list of POCUS knowledge and skills was narrowed to 38 items that addressed elements of six global competencies. The core leadership group then revised items into subcompetencies and categorized them under global competencies, developing a curriculum that defined the scope (depth of content) and sequence (order of teaching) of these POCUS knowledge and skill items. CONCLUSIONS: This expert, consensus-generated POCUS curriculum provides detailed guidance for PEM fellowships to incorporate POCUS education into their programs. Our curriculum also identifies core ultrasound knowledge and skills needed by PEM fellows to perform the specific POCUS applications recommended in prior publications.

How general pediatricians learn procedures: implications for training and practice.

The Accreditation Council for Graduate Medical Education (ACGME) requires General Pediatricians (GPeds) to learn thirteen procedures during training. However, GPeds infrequently perform these procedures in practice. We sought to determine:1) how GPeds learned procedures, 2) if GPeds self-reported achieving competence in the required ACGME procedures during training, and 3) if GPeds maintained these skills into practice. We conducted this mixed methods study from 2019-2020. 51 GPeds from central Ohio and the American Board of Pediatrics General Examination Committee were recruited via email or snowball sampling and participated in semi-structured recorded phone interviews probing procedural performance during training and current practice. Participants represented varied geographic regions and clinical settings. We employed Sawyer's 'Learn, See, Practice, Prove, Do, Maintain' mastery learning pedagogical framework as a lens for thematic analysis. Participants did not demonstrate competence in all ACGME required procedures during training, nor sustain procedural skills in practice. Most participants learned procedures through a 'see one, do one' apprenticeship model. GPeds reported never being formally assessed on procedural competence during residency. All GPeds referred out at least one procedure. GPeds also believed that skill maintenance was unwarranted for procedures irrelevant to their current practice. GPeds did not sufficiently demonstrate competence in all ACGME required procedures during training, partially suggesting why they infrequently perform some procedures. Alternatively, these required procedures may not be relevant to their practice. Pediatric residency procedures education might consider using mastery learning for practice-specific procedures and surface-level methods (learning without mastery) for other skills.

Fundamentals of Scholarly Peer Review: A Workshop for Health Professions Educators on Practicing Scholarly Citizenship.

Introduction: Education scholarship requires peer reviewers. For novice scholars, reviewing is an important developmental activity that cultivates deeper participation in the scholarship community. Yet getting started with reviewing is challenging for those not involved with the educational scholarship community. Beyond scientific expertise, reviewers must have a mentoring mindset, skills in providing constructive feedback, and knowledge of common ethical challenges associated with producing and evaluating scholarship. Methods: Our workshop introduced novice health professions educators to peer reviewing. It included four stimulus presentations about the peer reviewer's mindset and skills, followed by reinforcement activities. The workshop could be adapted to variously sized groups. An 8:1 ratio of participants to facilitators was ideal for activities. Topics covered included considerations before accepting an invitation, the review process, the good citizen approach to reviewing, and reviewer ethics. The session concluded with suggestions for continued development of peer reviewer competencies. The workshop was evaluated using a custom survey. Results: Throughout 2019 and early 2020, 58 health professions educators and trainees participated in the workshop across varied venues. Evaluations were obtained from 33 participants (57%). Nearly all rated the workshop as high quality and valuable to peer reviewer preparation. Most (26 of 33; 75%) gained confidence about their qualifications to serve as reviewers. Eighty percent (28 of 33) believed they could recognize ethical dilemmas. Discussion: This workshop provided a springboard for peer reviewing health professions education scholarship. Participants generally praised the experience for introducing them to the world of peer review and preparing them for it.

What Procedures Are Important to General Pediatricians and Why?

BACKGROUND/OBJECTIVE: Pediatric residents must demonstrate competence prior to graduation in Accreditation Council for Graduate Medical Education (ACGME) required procedures. Recent literature shows general pediatricians (GPeds) infrequently perform these procedures yet believe them important to learn. The purpose of this study was to determine why GPeds believe learning procedures was important, what barriers prevent them from developing and maintaining procedural skills, and what procedures they believe should be included in training. METHODS: Fifty-one GPeds from the American Board of Pediatrics General Examination Committee and the central Ohio region participated in 30-minute semistructured recorded phone interviews that probed their use of procedures across training and current practice. Participants represented urban, suburban, and rural geographic regions and practiced in a variety of settings. We conducted a thematic analysis of transcribed interviews. RESULTS: GPeds believed currently required ACGME procedures were crucial to learn for 5 reasons: 1) adaptation to change in practice type or location, 2) emergency preparedness, 3) counseling patients and families, 4) distance from a tertiary care center and specialists, and 5) professional identity as a pediatrician. Numerous barriers, particularly never learning the procedures, prevented GPeds from performing procedures in practice. Recommended procedures to be taught included high- (eg, circumcision), and low-risk (eg, cerumen removal, nasopharyngeal swabs, umbilical cauterization) skills. CONCLUSIONS: GPeds believed procedural training was important, however may never have learned certain procedures. These findings suggest that teaching methods should be adapted or customized procedural education should be implemented to ensure relevancy of skills learned for clinical practice.